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20 April 1 977 


MEMORANDUM FOR: | | 

Administrative Officer, DCI 

SUBJECT : Time Spent by National Intelligence Staff on 

Program Evaluation 


1 . The Staff spent the 
in the last calendar year: 

following man 

GS-18 

1 ,733 

GS-15 

1,642 

GS-09 

980 


2. These man-hours were spent primarily on the following program 
evaluation exercises: 

a- FOCUS Studies : The NIOs convene interagency 
working groups which examine the reporting from a 
specific mission abroad, identify the reporting's 
strengths and weaknesses, and make recommendations 
as to how the reporting might be improved. 

b. KIQs and KIQ Strategy Reports . Before any 
of these management guidance documents can be written, 
an evaluation of the current state of intelligence 
collection and analysis is required. 

c. Annual Work Prog rams . Particularly in the 
military estimative field, an evaluation is made upon 
the completion of major estimates to determine where 
the major gaps in our information and analysis exist 
and which analytical v/ork programs should be launched 
so that the next estimate can provide better answers 
to the questions on policymakers' minds. 

, i t : l , 


Executive Officer, UCl/Ni 
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13 April 




1977 


MEMORANDUM FOR: 


THROUGH 


Deputy Director for Administration 
Deputy Director for Intelligence 
Deputy Director for Operations 
Deputy Director for Science § Technology 
Executive Secretary 


Comptroller 1 4 1977 



SUBJECT 


Resources for Program Evaluation in Fiscal Year 1977 
-- 0MB Bulletin 77-8 


1. A report showing and commenting on the CIA resources devoted 

to Program Evaluation is due in the Office of Management and Budget on 
25 April. It is in our interest that the CIA submission show as 
thoroughly and carefully as possible Agency efforts to systematically 
analyze its programs to ascertain the extent that they "have achieved or 
are achieving their objectives, or are producing other significant 
effects " 

2. A copy of the actual OMB Bulletin is attached; it requires 

some interpretation. Basically ,■ the data desired is that showing the 
extent that CIA attempts to determine "what has actually occurred as the 
result of past program actions > plus our efforts to develop evaluation 
methodologies and ensure that these are incorporated into existing and 
future programs. The efforts identified should be intended to assist 
management. * 

3. For the purposes of this OMB tasking, program evaluation 
does not include: 


-- evaluation activities which are an intrinsic part of pro- 
gram operations or management; 

-- analyses of the relative cost/benefit of alternative 
approaches to programs that do not yet exist; 

-- the development and operation of management information 
systems ; 

-- the collection of routine data or the preparation of general 
statistics or basic research. 


CONFIDENTIAL 
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5. The attachment to the 0MB Bulletin shows the prescribed format 
for your input. Please give us a name of a contact person; we will not 
pass that name to 0MB. We propose to provide 0MB with data for eadfoF 
the four Directorates and for the Office of the Director. One staff -year 
should be counted for each full-time person who devotes more than fifty 
percent of. his/her time to program evaluation activities or to monitoring 
such activities by contractors ; part-time employees or employees working 
on evaluations less than fifty percent of their time are not to be 
included. A brief narrative description of program evaluation activities 
and of their expected inpact is to be included (two or three paragraphs 
per Directorate) . Significant increases or decreases in funding levels 
for evaluation activities from FY 1977 to FY 1978 are to be noted and 
major "policy or strategy changes" mentioned. 

6- A two- three page Agency summary narrative will be prepared by 
this office and we. welcome your suggestions. The data you provide 
should include activities of your components in support of interagency 
evaluation efforts (e.g., by the IC Staff) or of evaluation activities 
of other agencies. The Agency overview will note that CIA regularly 
participates in evaluations of Programs under the control of other 
Departments and Agencies. 

7 . Your data and narrative are needed by no later than COB 
21 April. We apologize for the tight deadline, but the QMB tasking only 
arrived in the Com ptroller's Office on 12 April, and the QMB deadline is 
Monday, 25 April. | ] Pm 3E58) , is25X1 

coordinating this ellort and he remains ready to talk further with yd25X1 
people regarding the nature and extent of the task. 



Requirements 5 Evaluation 

Attachment : 

As Stated 
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BULLETIN NO. 77-8 . i , , AD ril 4, 1977 

TO THE HEADS OF EXECUTIVE DEPARTMENTS. AND ESTABLISHMENTS 

SUBJECT: Resources for Program Evaluation in Fiscal Year 

1977 


1. Purpose . This Bulletin provides instructions for the 
submission, of information concerning the resources for 
program evaluation provided for in fiscal year 1977. 

2. Backgroun d . The Office of Management and Budget has 
determined the need to collect and analyze information on 
the level of Federal expenditures and staffing devoted to 
program evaluation activities. The information requested by 
this Bulletin is vital to an understanding of the magnitude 
of evaluation resources and the ways in which • these 
resources contribute to the achievement of national goals, 
agency missions, and program objectives. Moreover, 
increasing concern about the adequacy of data on program 
performance makes it necessary to assure that accurate 
information can be provided to the Congress and the public 
on the actual level of program evaluation expend itures . 

3. Coverage . These instructions apply to each executive 
department and independent agency with more than 800 
authorized full-time permanent employees. 

4. Definition . For purposes of this Bulletin, program 
evaluation means the formal assessment, through objective 
measurements and systematic analyses, of the manner and 
extent to which Federal programs (or their components) have 
achieved or are achieving their objectives, or are producing 
other significant effects of either a desirable or 
undesirable character, in order to assist future policy and 
management decisions. 

a. The .following will be considered as Federal program 
evaluation activities for the purpose of this Bulletin: 
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tUc purpose of determining the effectiveness, efficiency, or 
impact of a national or regional program. 


. Systematic assessment of demonstration programs 

or projects which are expected to have major impl ication fo r 
programs of national or regional scope; except that 
evaluation activities which are an intrinsic part of the 
program operations or management should not be reported. 

(3) Formal studies, surveys/ and data analyses .for 
the purpose . of assessing program management processes 
procedures, intervention techniques, workload distribution* 
or productivity. ' 


(4) 

to assure 
successfully 


Assessment and development of program 
that programs, once operational, 
evaluated. 


designs 
can be 


(5) Design, development, and field testing 
program evaluation methodologies. 


or new 


( 6 ) 

obtained by 


Synthesis and 
several previous 


further analysis of results 
program evaluation efforts. 


(7) 

evaluation 

evaluations. 


Collection 
design and 


of initial 


d; 


iuta to help in 
provide a baseline for subsequent 


b. The following will not be considered as oroqram 
evaluation activities for the purposes of this Bulletin. 


(1) Design, ; development, and operation of general 
data systems or management information systems. 


(2) Continuing collection of routine data and 
general purpose statistics. 


(3) Analysis of existing or proposed policies where 
no programs yet exist (even though authorized) for purposes 
of appraising the likely costs and effects of feasible 
alternatives. Although such analyses are often called 
evaluations," they are prospective in character; whereas 

at determining 
of past program 


program evaluation is retrospective, aimed 
what has actually occurred as the result 


actions . 


(4) Basic research 
or foster general knowledge 


and studies 
Development 


intended to increase 
but which are not 
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LU ue UBBU speciricaily and primarily in policy and 
managemen' decisions. 
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(5) Routine, day-to-day monitoring of 
operations which is an intrinsic part of 
administration. 


program 
prog rata 


• c recognized that the present extensive 
variation among Federal agencies and programs will require 
case-by-case judgments to determine the applicability of the 
above et iteria to agency "evaluation" activities. 

*LjJ2£ L irements . Departments and agencies should 
submit a report in accordance with the attached instructions 
ana exhibit to OMB, attention: Evaluation and Program 
Implementation Division by April 25, 1977. This is a one- 
time report . 

k* 5 c t s s i QJ2 . This Bulletin is rescinded following 
receipt of the April 25, 1977 report. 

] * In q u i r ies . Inquiries and requests for assistance should 
be directed to the Evaluation and Program Implementation 
Division, Office of Management and Budget. (395-4726 or 
395-0642.) 



Bert Lance 
Director 


Attachment 

< i 

i 
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An original and one copy of the report on program evaltn-t-ion 
resource^ will be prepared on letter size sheets' (8x10-1/2) 

th<? th = «tached 


Da_te Enter the date of preparation 

Co nta ct - Enter the name and telephone number of an 
indiyiaual who can respond to questions relative to 
the information provided. 


Part 2_ RESOURCES SCHEDULE: 


Departmen t /Ace ncy /B u r 
independent agency, 
enter each bureau 
which separate evalua 
can be identified, 
organizational units 
the total departmen 
be left between each 


can - Enter the reporting department or 
- n the case of cabinet departments f 
or comparable organizational unit for 
tion resources (funds and personnel) 
a . consolidated line entry for any other 
(if applicable), and a line entry for 
t or agency. At least one space should 
line entry. 


S_tcpEf years Enter the estimated staff-years for full-time 
personnel, who devote more than fifty percent of 
P^pu^am^evaluation activities outlined in 


permanent 
their time 
paragraph 
government 
activities 


4 a of thi: 


Bulletin 


This includes full-time 


personnel engaged in monitoring or directing such 
by contractors or grantees. 


Sa lar ies — Enter 


es u imated obligations for personnel 


compensation related to the staff-year entry. 


Personnel Benefits - 


Enter the 


i — — estimated obligations f nr 

personnel benefits associated with the salary figure. 

f^u ' rred S fo^Pv S r ?- ter the estin,ated obligations to be 
of n ti nrrl ! Uaa ° n contracts or grants, or, in the case 
oo^mrs of ? agreements, the obligations for those- 
po.u.ons of the contracts or grants that are direct lv 
^e-aueo uo she program evaluation activities des^rib^a in 
paragraph 4a of this Bulletin. ^rib.J in 


|r— E " ter th0 total obligations estimated for 

; r ddminiotratxvs expanses directly related to i-ho 

perrormance, commissioning, or oversight of the activities 
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described-^ in paragraph 4a of this Bulletin- "Othes 
expenses” would include obligations for travel anc 
transportation of persons, transportation of things, rent, 
communications and utilities, printing and reproduction, 
other services (such as ADP services), supplies anc 
.materials, and equipment. Significant obligations for anj 
of these "other expenses" should be briefly identified in 
the narrative. 

Total - Enter the total estimated FY 1977 obligations for 
salaries, personnel benefits, contracts/grants, and other- 
expenses. Note : All obligations are to be entered in 

thousands of dollars. 

Part II. NARRATIVE STATEMENT 


A orief explanatory statement should describe in general 
terms the program evaluation activities being undertaken and 
the objectives toward which they are directed. It should 
highlight significant increases or decreases in funding 
levels, from the current fiscal year to FY 1978 and major 
policy or strategy changes expected to occur. Emphasis 
snould • be placed on the expected use of evaluation 
information in the agency resource allocation and other 
decision processes. In most instances, the narrative for 
individual bureaus should be restricted to two or three 
paragraphs and the departmental or agency summary should not 
exceed two pages. 
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EXHIBIT 
Bulletin No 


REPORT ON FY 1*7? PROGRAM EVALUATION RESOURCES 
(Dollars in Thousands) 


Date: 

Contact: 

Part I. RESOURCE SCHEDULE 


Personnel Contracts 

Staff Years Salaries Benefits Grants 

Dep ar tmen t/Agency/Bur eau (_$J ( $ ) ( $ ) 

Department of Government 
(Report breakdown of major 
bureau or other organiza- 
tional unit for cabinet 
departments only) 


PART II. NARRATIVE STATEMENT 


Other 

Expenses 

(?) 
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19 April 1977 


MEMORANDUM FOR: NIO/AF 
NIO/EAP 
NIO/CH 
NIO/USSR 
NIO/WE 
Act NIO/LA 
NIO/NESA 


Please find attached priority lists which show in the 2. and 3. series 
(economic and military) where your suggested priorities for the DCID 1/2 
matrix disagree with those suggested b y others. The EIC and the mi litary 
feel strongly about their suggestions; | p ere 25X1 

involved in the economic priorities, which represented also the combined 
views of State, Treasury, and OER. If you wish to insist on your numbers, 
please let me know by COB, Tuesday, 19 April. The DCID 1/2 Ad Hoc Working 
Group will be meeting on Wednesday a fternoon and Thursday morning to 
25X1 resolve the differences. I l and I will have a go at resolving any 

strongly held differences in economic priorities before tomorrow's meeting. 


25X1 


Executive Officer, DCI/NI 

Attachment 
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